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We extend the definition of non-adiabatic entropy production given for Markovian systems in [M. 
Esposito and C. Van den Broeck, Phys. Rev. Lett. 104 090601, (2010)], to arbitrary non-Markov 
ergodic dynamics. We also introduce a notion of stability characterizing non-Markovianity. For 
stable non-Markovian systems, the non-adiabatic entropy production satisfies an integral fluctuation 
theorem, leading to the second law of thermodynamics for transitions between non-equilibrium 
steady-states. This quantity can also be written as a sum of products of generalized fluxes and 
forces, thus being suitable for thermodynamics. On the other hand, the generalized fluctuation- 
dissipation relation also holds, clarifying that the conditions for it to be satisfied are ergodicity 
and stability instead of Markovianity. We show that in spite of being counter-intuitive, the stability 
criterion introduced in this work may be violated in non-Markovian systems even if they are ergodic, 
leading to a violation of the fluctuation theorem and the generalized fluctuation-dissipation relation. 
Stability represents then a necessary condition for the above properties to hold and explains why 
the generalized fluctuation-dissipation relation has remained elusive in the study of non-Markov 
systems exhibiting non-equilibrium steady-states. 
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I. INTRODUCTION 

The lack of a formalism useful to describe, on the same 
footing, many different out of equilibrium systems, is 
one of the most important unsolved problems in ther- 
mostatistics. While the equilibrium thermodynamics for 
ergodic systems can be derived from the statistical the- 
ory of Gibbs, out of equilibrium systems exhibit a great 
diversity, thus making difficult the unification of their 
description within a single theory. 

Fluctuation theorems (FT) [1-11] are exact relations 
for the probability distributions for the values W of ob- 
servables W which are functionals of the stochastic state- 
space system trajectories (e.g. work, heat or more gen- 
erally, different forms of trajectory-dependent entropy 
production) in processes driven by arbitrary protocols. 
These relations, valid even beyond the linear regime, con- 
tain as particular cases the Green-Kubo formula, the On- 
sager reciprocity relations and the second law of thermo- 
dynamics for systems with equilibrium steady states in 
the limit of small entropy production[3, 12]. For systems 
with non-equilibrium steady states (NESS), they provide 
a generalization of the second law of thermodynamics [8] 
which gives a formal framework for the phenomenological 
theory of Oono and Paniconi[13] for the thermodynam- 
ics of NESS. In this case, also a generalized fluctuation- 
dissipation relation (FDR) can be derived[14-22, 42], as 
well as some 'symmetry' relations for the response func- 
tions involved in this generalized FDR[23, 24]. For a 
recent review on fluctuation theorems and their applica- 
tions, see [25]. 

For all these reasons, FTs seem to be a good starting 
point in order to derive a more general theory unifying 
the physics of many different out-of-equilibrium systems. 
In fact, many features of Markovian systems are well de- 
scribed within the same formalism. 

In spite of this, non-Markovian systems demand much 



more work and comprehension. 

In the previous recent years, some important progress 
has been made in this line. For example, the work fluc- 
tuations theorems (Jarzinsky identity and Crooks fluc- 
tuation theorem) as well as the fluctuation theorem for 
the total entropy production have been derived for non- 
Markvovian systems evolving with ergodic dynamics [26- 
29]. On the other hand, an asymptotic FT relevant for 
glassy dynamics has been derived in [30] , while the valid- 
ity of the work relations has been studied in the context 
of anomalous dynamics for the first time in [31]. A dis- 
cussion on the role of substitute Markov processes has 
been presented in [36]. 

However, a lot of work remains to be done. For sys- 
tems with NESS the entropy production associated to 
the total heat exchanged with the bath does not repre- 
sent a relevant lower bound for the entropy change in the 
system [8]. In fact, the entropy production which gives 
the most accurate lower bound should be related to the 
transitions of the system between different steady states. 
When detailed balance holds, all the heat exchanged with 
the reservoir is used for the system in order to jump from 
one steady state to the other, however, without detailed 
balance, part of this heat is used in order to maintain an 
steady-state with non-vanishing currents. In this case, 
the correct lower bound is given by the excess entropy, 
associated to the excess heat, which is the energy deliv- 
ered or absorbed for the system when it jumps between 
different steady states [8] . Then, a description in terms of 
the Hatano-Sasa functional, or more generally, in terms of 
the non-adiabatic entropy production [32, 33] is needed. 
As far as we know, these quantities have not been studied 
yet for non-Markov dynamics. 

The aim of this paper is to fill this gap. In fact, we show 
that the non-adiabatic entropy production, as defined for 
Markovian systems, can satisfy an integral fluctuation 
theorem (IFT) if the system fulfills certain "stability" 
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condition which we discuss below. In this context it is 
possible to extend the second law for transitions between 
NESS and the validity of the generalized FDR to non- 
Markov dynamics. 

The paper is organized as follows. In section II we 
present the basic notations and introduce the evolution 
operators for some "substitute Markov processes" rele- 
vant for the definition of generalized fluxes. In section 
III we introduce our concept of stability and discuss an 
important property of stable systems. In section IV we 
introduce the non-adiabatic entropy production and we 
derive some of its most fundamental properties, as the 
validity of an IFT. In this section we also discuss the ex- 
tension of the NESS thermostatistics to non-Markovian 
ergodic and stable systems. In section V we study a 
model system violating the stability criterion: a parti- 
cle dragged through a viscoelastic liquid. The general- 
ized FDR is tested for an overdamped harmonic oscil- 
lator coupled to two non-Markovian baths at different 
temperatures in section VI. Finally, some concluding re- 
marks are given in VII. 

II. PRELIMINARIES 
A. Basic definitions and notations 

To start, we will consider continuous time processes for 
a system that can be described either by discrete or con- 
tinuous configurations. A configuration will be denoted 
by x, which may generically represent a single variable, a 
vector, or a field. The system can be additionally driven 
by a set of time-dependent external parameters which 
will be denoted by A. 

Trajectories from the initial time ti = to the fi- 
nal time tf = t will be denoted by vectors, so that 
e = {e(r)}^ =0 , with e = (x, A). 

Otherwise stated, stochastic functionals (like entropy 
productions) will be denoted by calligraphic capital let- 
ters, while specific values for these functionals will be 
denoted by the same, capital but latin character. For ex- 
ample, the non-adiabatic entropy production functional 
will be denoted by 5 na [af; A], while for the specific values 
of this quantity we will write 5 na . 

We assume, as a fundamental requirement in our theo- 
ry, that the system is ergodic. 

Let us denote by p(x, t) the probability density func- 
tion (PDF) for the system to be in the vicinity of con- 
figuration x at time t and by p s (x;X) the steady state 
PDF for a constant protocol A(t) = A. Given the non- 
Markovian nature of the process, one should be careful in 
order to introduce this distribution, as the system at any 
time (except for the initial time i,-) is correlated with its 
previous history. Ergodicity ensures that at constant pro- 
tocols the system forgets its initial preparation for long 
enough times, so p s (x; A) should be thought as the lim- 
iting PDF reached by the system at time t — > oo, if the 
protocol is stopped at time f'<t with value A(i') = A. 



The initial PDF will be assumed arbitrary and denoted 
by po(x). On the other hand, conditional probabilities 
will be denoted by K. 

Finally, the evolution operators for the substitute 
Markov processes (which will be introduced in the next 
paragraph), will be generically denoted by C. 

B. Substitute Markov processes 

In general terms, the evolution equation for the one- 
time probability density of non-Markovian processes in- 
volves convolutions in time, making explicit the fact that 
the system is correlated with its past. Fokker-Planck 
equations with fractional time derivatives constitute very 
known examples of this fact. However, the evolution 
equation can, under very general conditions, be written 
in a convolutionlcss (not memoryless) form in terms of 
an evolution operator related to some 'substitute' Markov 
process having the same one-time probability as the origi- 
nal non-Markovian process [34, 35]. The evolution equa- 
tion reads 

d tP {x,t) = £(t;t n [X])p(x,t) 7 (1) 

where we have made explicit the fact that the evolution 
operator depends on the initial time, and also on the 
whole protocol up to time t. This reflects the effect of 
the memory of the process. The form of the operator 
also depends on the initial PDF of the system at time 
ti, where it is prepared without any correlation with pre- 
vious times. This means that to each particular prepa- 
ration of the system, corresponds a different Markovian 
substitute. When the process is Markovian, the correla- 
tion with the previous history is no longer present and 
the given operator generates a semigroup, independently 
of the initial PDF. In this case one recovers the usual 
Master (Fokker-Planck or Kramers) equation for discrete 
(continuous) variables. 

In what follows, we will drop for simplicity the initial 
time and the protocol dependency on the arguments of 
the evolution operator, so we will just write C(t). 

The evolution equation (1) can be easily derived from 
the general properties of conditional probabilities [34]. In 
fact, let K(x,s\x',t) be the conditional probability for 
the system to be in the vicinity of x at time s given that 
it was around x' at time t. One then can write for any 
process, being or not Markovian 

p(x,s) = J dx'K(x,s\x',t)p(x',t). (2) 

It is worth noting that if the process is non-Markovian, 
the conditional probability will depend on the whole his- 
tory up to time s. From the previous equation it is easy 
to see that 

d t p(x,t) = dx'M(x,x',t)p(x',t), (3) 
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where M(x,x',t) = lim s _ > . t + d s K (x, s\x' , t), from where 
it is immediate to identify the operator C. 

III. STABILITY 

We say that a non-Mar kovian system is stable if it, 
being prepared at the initial time (where there is no cor- 
relation with the previous history) with the steady-state 
PDF corresponding to A, evolves in such way that if A 
does not change in time, then for all times the PDF re- 
mains unchanged. With a Mar kovian process in mind, it 
may seem to be counter-intuitive that the stability crite- 
rion could be violated, but for non-Markovian dynamics 
the violation may indeed occur in many realistic models. 
In order to understand why is it possible, we first make 
the reader to note that for Markovian systems there is 
no difference between preparing the system in an arbi- 
trary state in a very remote moment in the past and to 
start to observe it at t = 0, when it has evolved to its 
steady-state, and to directly prepare the system in the 
steady-state at t = 0. This is so, because previous his- 
tory does not matter at all. However, this is not the 
case for non-Markovian dynamics. Consider the condi- 
tional probability for the system to be around x at time 
t, given that it was for sure at xq at time to = 0, in two 
different contexts, when the system is prepared initially 
at t = with the steady-state PDF without any correla- 
tion with its previous history and when the system were 
prepared at t = — oo in an arbitrary state, letting the 
value of A unchanged. Let us denote these propagators 
by K(x,t\xo) and K OQ (x, t\xo) respectively. It is clear 
that, in general, K(x,t\xo) ^ K oc (x,t\xo). Also note 
that J dxoK 00 (x 1 t\xo)p s (xo; \) = p s (x;X). Then, it may 
be possible that 

J dx K(x,t\xo)p s (x ;X) ^p s (x;\), (4) 

leading to the instability that we are describing. In 
words, in both cases the position at t — is sampled from 
the steady-state PDF, but in the first case, the system 
is not really in its steady-state which, for non-Markovian 
systems, is not entirely determined by the one-time PDF. 

The stability criterion introduced above is in fact ab- 
stract since in practice the typical, and to be best of our 
knowledge the only, achievable way to prepare a system 
so that it is described by its steady PDF, is allowing 
it to evolve for a long enough time keeping the values 
of the external parameters fixed, as considered in [26]. 
However, we will see below that one does not actually 
need to be able to prepare the system sampling its ini- 
tial values from the steady PDF, and that considering an 
arbitrary initial distribution, the problem of the validity 
of the fluctuation theorem for the non-adiabatic entropy 
production is mapped to the problem of its validity in 
the hypothetical case we are discussing (see equations 
(13) and (14) below). Then, the main lesson extracted 
from this abstract concept is that the lack of stability 



gives information about the dynamics of the system in 
realistic situations: the fluctuation theorem for the non- 
adiabatic entropy production does not hold for any initial 
preparation, even in experimentally accessible conditions 
if one considers the evolution of the system at finite times 
and not in the asymptotic regime considered, for exam- 
ple, in [30] . A practical way to identify unstable systems 
in realistic situations will be discussed in terms of the 
fluctuation-dissipation theorem in a future work [46] . 

To continue with our discussion, let us introduce the 
Hatano-Sasa functional y defined as [8] 

y[x;X}= f drA(r)9 A 0(x(r);A(r)), (5) 
Jo 

with cj)(x; A) = — lnp s (x;A). Let us also introduce 
P s (x,Y,t), the joint PDF for the system to be in con- 
figuration x at time s = t, having observed a value of 
the Hatano-Sasa functional Y, when the initial condition 
is sampled from the steady state PDF, and its Laplace 
transform P s (x,Y,t) = J dYe- y9 P s (x,Y,t). Let us de- 
note P s (x,t) = P s (x,Y = l,t). It turns out that for 
stable systems, we have the identity 

P s (x,t)=p s (x,\(t)). (6) 

The proof of this statement is based on a general prop- 
erty of correctly defined substitute Markov evolution op- 
erators which has been shown in [26] , say 

C(t)p a (x;X(t)) = Vt>0, (7) 

for arbitrary protocols if the system is prepared in its 
steady-state. It is worth to say that, for the evolution op- 
erator to be correctly defined, a full phase-space descrip- 
tion (inclusion of all the degrees of freedom) is needed, 
as suggested by Ref.[36]. In that reference, it has been 
shown that for correlated noises the velocity ceases to be 
an slow variable and should be included in the determi- 
nation of the substitute evolution operator, even if one 
is studying the probability of a quantity which does not 
depend on velocity. Equation (6) can be shown by simple 
inspection by noting the evolution equation for P s (x,t) 

d t P s (x,t) = C(t)P s {x,t) - \(t)d x cf>(x;\(t))P s {x,t), (8) 

with initial condition P E (x,0) = p s (x;\o) and using the 
identity given by equation (7). Equation (8) can be 
obtained by Laplace transforming the evolution equa- 
tion for P s (x,Y, t), which corresponds to the same equa- 
tion for the PDF of the x variable plus an extra term 
associated to the current in the Y direction Jy(t) = 
\(t)d x 4>(x;\(t))P s (x,Y,t) 

d t P a (x,Y,t) = £{t)P B (x,Y,t) - dyJ Y (t). (9) 

The above reasoning seems to be correct, but there is 
some important condition that has to be satisfied: sta- 
bility. In fact, if stability does not hold, then (7) and 
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correspondingly (6) do not hold either. In order to see 
this, let us assume that (7) holds for arbitrary proto- 
cols, but the system is unstable. Then, for constant 
protocols one should have, by virtue of instability, that 
p(x, dt) p s (x; Xq). On the other hand, by virtue of (7) 
we have p(x, dt) = p s (x; Xo)+dtC(0)p s (x; Aq) = p s (x;Xo). 
This contradiction is solved only if (7) does not hold for 
unstable systems. 

As previously announced, in section V we study a sim- 
ple unstable system. The skeptic reader could argue that 
this instability is artificial, since the violation of (7) may 
be associated to a by-product of the substitute Markov 
process provided that one does not have a method to de- 
fine it correctly in the general case. For this reason, we 
discuss the instability of the model system presented in 
V not by means of substitute Markov processes, but di- 
rectly using generalized Langevin equations (GLE) meth- 
ods, which are always correct [36]. On the other hand, 
in section VI we study an stable system, where the gen- 
eralized FDR holds. 

Before finishing with this section, we would like to 
briefly discuss about some systems where stability could 
be violated. If one considers out-of equilibrium degrees 
of freedom performing non-Mar kovian dynamics, some 
"effective" non-local time-dependency on the protocol 
can be self-generated by performing local transforma- 
tions of variables, a feature exclusively associated to non- 
Markovianity (see section V). On the other hand, if the 
non-Markovian noise acting on the system does not sat- 
isfy an equilibrium FDT of the second kind (at least in 
terms of an effective temperature), the system is unsta- 
ble. 



IV. NON-ADIABATIC ENTROPY 
PRODUCTION 

A. Definition 

This paragraph is devoted to present the main defini- 
tion of non-adiabatic entropy production and its physical 
meaning. This entropy production have been introduced 
for the first time in Refs. [32, 33] for Markovian sys- 



tems. We will define it here in the same way, but it will 
be written in a different (although equivalent) form. We 
define 



<S na [x; A] 



Po(x( ti ))ps(x(t f y,\(t f )) +y[ 1 



(10) 

Note that, as in [33], a splitting of the non-adiabatic 
entropy production into a boundary contribution and a 
driving contribution becomes apparent. The first term, 
accounts for the relaxation of the system to the steady- 
state, while the second term is only non-zero in the pres- 
ence an external protocol. 

It is also worth saying that in [32] this quantity have 
been defined as the logratio of the path probabilities of 
two different systems, obtaining (10) as a result. We 
use here (10) as formal definition, avoiding any reference 
to path probabilities and hence, making this definition 
extensible to non-Markov dynamics without identifying 
any 'dual' dynamics, since, even if for Markovian systems 
the dual dynamics can be straightforwardly associated 
to a system with different interactions [23, 24, 37], for 
non-Markov dynamics this identification could be more 
intrincate. 



B. Integral fluctuation theorem 

In order to start with the derivation of the IFT for 
the non-adiabatic entropy production, we point out first 
that, according to equation (10) we can write 



= p{x,t)p s {x ;X ) ^ 
Po(xo)p s {x, X(t)) 



(11) 



where Xq corresponds to the initial position while Ao — 
A(0). Let us now introduce the conditional probability 
for the system to be in configuration x at time t, and 
having observed a value of the Hatano-Sasa functional 
Y, given that it was in configuration xq at ij = 0. The 
initial value of the Hatano-Sasa functional has not to be 
specified since it is always zero. Let us denote this con- 
ditional probability by K(x,Y,t\xo). For any observable 
of the form A(x, Y, t, Xq) one can write 



(A(x, Y", t, x Q )) = J dxdx dYA(x, Y, t, x )K(x, Y, t\x )p (x ), (12) 

which implies 

(.-«-> - / " ^{Z^ KM'to*-* = f /^P.(x,r,<)e-, (13) 

I 

which directly leads to If the system is stable in the sense discussed in the pre- 

vious section, we have 

^=h p '^p^wy (14) (e^> = i- (15) 
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Equation (15) is the first main result of this paper. 
It encodes most of the fundamental aspects for the non- 
adiabatic entropy production to be a meaningful thermo- 
dynamic quantity for ergodic systems. It is worth noting 
that if the invariant measure of the system corresponds 
to the Boltzmann-Gibbs distribution and the system is 
initially prepared in this state, the previous result re- 
duces to the Jarzynski relation, already derived in [26] 
for general non-Markovian ergodic systems following an 
approach based on Markov substitute processes, and in 
[27, 29] for non-linear generalized Langevin systems by 
means of an approach based on functional probabilities 
of trajectories. 



Second law 



Let us introduce the excess entropy functional S ex [8] 



as 



5 ex [x;A]=— / dTxd x (j>{x; A). (16) 
Jo 

For discrete spaces, the integral in (16) should be re- 
placed by a sum as S fc=1 [<^(a:fc-i; A t J - <t>(x k ; A t J], 
where k — 1,2, ... ,N labels the set of time instants when 
the system jumps between different configurations. From 
(10) and (16) we can write 



iS na — AS S + S e 



(17) 



with AS S — — \np(x(t),t)/p (x ) the entropy change of 
the system. From (15), (17), and the Jensen inequality, 
it follows 



(AS e ) > -(S e 



(18) 



Equation (18), which is a direct consequence of (15), is 
the second main result of our paper. It represents the 
second law of thermodynamics for transitions between 
NESS exactly as expressed in [8]. 



D. Generalized fluxes and forces 



From (3) and the normalization condition for PDFs, one 
can see that / dxM{x,x' ,t) — 0. Then, we can safely 
add a zero to equation (20) as 



dxdx'M(x', x, t)p{x, t) In P } X \ t } = 0, (21) 



p*(x;X(t)) 



obtaining 



d_ 
dt 



(<Sna) = — [ dxdx'Jix, x' , t) In — ^~ 
J P s (x; 



p(x ,t) 
A(t)) 



, (22) 



with the fluxes J{x,x',t) — M(x,x' ,t)p(x' ,t) — 
M{x' ,x,t)p{x,t). Note that J(x,x',t) = -J(x',x,t), 
as it should be. Changing now x by x' in (22), sum- 
ming the resulting equation term by term with (22) and 
dividing by two, we finally obtain 

^(5„ a > =-\j dxdx'J{x,x',t)F{x,x',t), (23) 



with the forces !F{x,x' ,t) = In 



p s (x'-\(t))p(x.t) 
p'(x;\(t))p(x',t) 



Equation 



(23) constitutes the third main result of our work. 

For general non-Markovian dynamics it is a hard task 
to build the evolution operator for the Markovian substi- 
tute process (except for Gaussian and two-level systems 
[34, 35]), so, the generalized currents can be hard to com- 
pute, however, equation (23) may be very important from 
the conceptual (and hopefully also from the experimen- 
tal) point of view. We also point out that this property 
is valid even if the system is unstable. 



E. Generalized fluctuation-dissipation relation 

As expressed previously, if the stable system is initially 
prepared in the steady-state compatible with some values 
of the external protocols, then equation (15) reduces to 
the Hatano-Sasa identity 



exp 



dTX l d\ i (f)(x; A*) 



(24) 



Another important property (not directly derived from 
(15) but also crucial in order to build a coherent ther- 
mostatistics) is that the time derivative of the average 
non-adiabatic entropy production can be expressed as a 
sum of products of generalized fluxes and forces, as for 
Markov dynamics [33]. From the definition (10), it fol- 
lows that 



d 
dt 



(<Sna) = - / dxd t p(x, t) In - 
J V 



>(x;\(t)Y 



(19) 



Recalling now (3), we can write 
d 



dt 



(Sn 



dxdx' M{x, x' , t)p{x' , t) In 



p s (x;\(t))- 
(20) 



where we have explicitly introduced the index i to label 
all the external parameters. Suppose that at the initial 
time we have Xi(t = 0) = A^o and that for t > we 
have Xi(t) = X i0 + SXi(t), with \SX l /X lQ \ < 1. Then, 
introducing the observables bi(t) — 9 A .0(x(t); A ) and 
repeating the same steps as in Ref. [18], we have the 
generalized FDR 

=%f o M^W)W)U&*iV)i (25) 

where (...) denotes averages in the perturbed system, 
while (. . .) ss denotes averages in the unperturbed sys- 
tem, where the parameters are kept fixed at their initial 
values. Note that, if stable, the system prepared in the 
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steady-state remains there always as long as one does not 
perturb it. This justifies the double-s subscript. 

Equation (25) constitutes the fourth main result of 
our paper. It is, in our opinion, a rather important re- 
sult since it is commonly claimed to hold exclusively for 
Markovian dynamics. This is, to the best of our knowl- 
edge, the first time that this relation is extended, in this 
particular way, to non-Mar kovian systems, clarifying that 
the crucial conditions for (25) to hold are ergodicity and 
stability and not Markovianity. We however point out 
that FDRs for non-Markov dynamics have been studied 
before (see for example the pioneering work [34] , and the 
more recent work [47]). 



V. A MODEL SYSTEM EXHIBITING 
INSTABILITY 

In this section we will study a model system exhibiting 
instability. In this case, the Hatano-Sasa relation is vi- 
olated and correspondingly, the modified FDR does not 
hold. In this model, we consider the steady-state distri- 
bution of a genuine non-equilibrium degree of freedom for 
which the equation of motion is obtained from the orig- 
inal equation of motion by means of a local transforma- 
tion, generating a non-local dependency on the external 
protocol. The system is ergodic, however if it is prepared 
at t — without any correlation with the past, in such 
a way that the initial position is sampled from the cor- 
responding steady-state PDF, and the external protocol 
is kept constant, it abandons its initial state and returns 
to it after a transient time. 

Consider the following GLE: 



drj(t - t)x{t) = -k(x(t) - x c {t)) + f(i), (26) 



where the Gaussian noise £ (t) have zero mean and a sec- 
ond cumulant (£(t)£(t')) = Tj(\t - t'\), with T the tem- 
perature of the bath. This relation is not sufficient in 
order to ensure the ergodicity of the dynamics (see for 
example [38]). We here assume that the system is er- 
godic. We also point out that equation (26) can serve as 
a model for a particle dragged through a viscoelastic liq- 
uid by an optical trap, which is experimentally accessible 
[40]. 

If we consider as the external protocol the position 
of the trap center, we see that the system described by 
(26) reaches an equilibrium state for constant x c , which 
means that the degree of freedom x is able to equilibrate. 
Imagine now that we consider as external protocol not 
the position of the trap center, but its velocity v c (t) as 
in the experiment in [39], such that a constant protocol 
means constant velocity. In this case, the variable a; is a 
genuine out-of-cquilibrium degree of freedom which is not 
even allowed to reach an steady value. We can however 
recover a variable capable to reach an steady value if we 
consider the quantity y(t) = x(t) — x c (t), which is also a 



genuine out of equilibrium degree of freedom. In terms 
of the variable y, the equation of motion reads 



dT ^t - r)y(r) = -ky(t) + F(t) + £(t), (27) 



where the force F is given by 



Jo 



drj(t - t)v c (t). 



(28) 



Note that even for constant velocity, this force is time 
dependent. This non local in time dependency on the 
external protocol will have drastic consequences. Also 
note that for Markov dynamics with -f(t) ~ S(t), the 
dependency on the external protocol becomes local. 

The solution of (27) can be found by means of the 
Laplace transform and reads 



y(t) = G 1 (t)y 



drGi{t - t)v c {t) + T?(t), (29) 



where r)(t) = f Q drG2(t — t)£(t). The quantities G\(t) 
and G-zit) are the inverse Laplace transforms of G\(u) 
and G^iu) given by 

G 2 (u) = [«7(«) + k}- 1 ; Gx(u) = j(u)G 2 (u). (30) 

The noise r\ has zero mean and correlator 

A(M') - (v(tW)) = ~[G 1 (\t-t'\)-G 1 (t)G 1 (t')], 

(31) 

as can be easily shown by direct calculation in the 
Laplace space. Note that ergodicity requires that 
lim t _ i . 00 G\ (t) = 0, while compatibility with the initial 
conditions demands G\(t = 0) = 1. We also note that 
from (30) we can obtain the following identity 



Gi(t) = 1 - kH(t), 



(32) 



with H(t) = J Q drG2(r). One can see, by using (29), 
(31), and (32), and using the properties of G\ that for 
constant v c the system reaches the following distribution 



p s (y;v c ) 



2ttT 



exp 



k{y + 7e c ? f v c f 



2T 



(33) 



where = J e if(t -> 00), and J eit (t) = J Q drGi(r). 
Now let us assume that the initial position of the particle 
is sampled from this distribution, which means that 



(2/o) 



T 



« = 



k' 



(34) 
(35) 



where Syo — yo — (j/o)- Using this in (29) for constant v c , 
we obtain that still (Sy 2 (t)) = (dy^) — ?, with Sy(t) = 
y(t) — (y(t)), however, the mean value of the process is 

(V(t)) =-bStG 1 (t)+j mtl (t)]v c ? (y ). (36) 
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As the process is Gaussian, this is enough to ensure that 
p{y,t) 7^ p s (y;v c ) for finite times, thus, the system is 
unstable. Note however that 



lim (y(t)) = (yo) 



(37) 



which means that the system decays again to the steady- 
state PDF. 

We remark once again that this instability is the re- 
sult of sampling the initial position from the steady-state 
PDF at the very beginning of the evolution, where the 
system is uncorrelatcd with the bath and its previous his- 
tory. Once the system reaches the steady state after a 
long time in interaction with the thermal bath, this in- 
stability disappears. In other words, in this model the 
instability is associated to the fact that initially, even if 
the system is prepared with the steady-state PDF, the 
non-local force defined by (28) depends on time even for 
constant protocols. This does not happen for a system 
prepared far away in the past. When this time-depending 
force relaxes, the instability disappears. 

Finally, it is worth noting that in the Markovian case 
the instability is no longer present. In fact, if 7(f) = 5(t), 
then Gi(t) = e~ kt and j eM (t) = j^{1 - G t (t)], with 
7^ f = 1/k. Using this in (36), we immediately see that 
(y{t)) — (yo) for all times. 



VI. OVERDAMPED HARMONIC OSCILLATOR 
COUPLED TO TWO NON-MARKOVIAN BATHS 

We will now test the validity of (25) for non-Markovian 
ergodic systems considering a very simplistic (and more 
unrealistic than the previous one) model, but useful in 
order to illustrate our findings. Consider an overdamped 
harmonic oscillator, coupled to two non-Markovian baths 



dr[7i(i - r) + j 2 (t - t)]x(t) = 
-fcc(*) + /(*)+ &(*)+&(*), 



(38) 



with Gaussian noises with variances (£r/(i)£i/(i')) = 
Tu7u(\t — v = 1,2. The force / will be considered as 
an external protocol. We can identify the heat exchanged 
with each reservoir 



dQ v {t) 



dr~f u (t - r)i(r) - £„(t) 



x(t)dt, (39) 



the energy change 

dE(t) = kx(t)x(t)dt, (40) 

and the work 

dW(t) = f(t)x(t)dt, (41) 
from where the first law of thermodynamics follows 

dE{t) = dW{t)-dQ{t), (42) 



with the total heat dQ = dQ\ + dQ 2 . In order to ensure 
the ergodicity and the stability of the dynamics, we take 
the two baths to be identical, so 71 (i) = 72 (t) — \^{t). 
Introducing then the effective temperature T ef f = \ {T\ + 
T2), we can write for the dynamics of the system 



d T1 (t - t)x{t) = -kx(t) + f(t) + £(t), (43) 



with (£(*)£(*')> = T elt f(\t - t'\). The solution of this 
equation is given by 



x{t) = G x {t)x + drG 2 (t-r)f(r) + ri(t), (44) 
Jo 

with Gi , G2 , and r\ as given in V. Then, the steady-state 
PDF for this system is given by the Boltzmann-Gibbs 
distribution 



exp 



(kx-f) 2 
2fcT eff 



(45) 



As (45) is similar to an equilibrium PDF, one should be 
tempted to believe that the average total entropy pro- 
duction rate in the steady state is zero, however, this is 
incorrect. One can, for example, read an illuminating 
discussion about this point in Ref. [43], where the en- 
tropy production of a spin model in one and two dimen- 
sions have been studied. As the authors correctly pointed 
out, an steady-state PDF of the Boltzmann-like type is 
not sufficient to ensure that the system is in equilibrium. 
What really defines equilibrium is detailed balance, or in 
a more macroscopic language, the vanishing of the aver- 
age entropy production. In this sense, one should also 
note that, even if the coarse-grained description given by 
(43) correctly estimates the non-adiabatic entropy pro- 
duction, it severely underestimates the total entropy pro- 
duction, as pointed out in the second reference in [33] for 
a Markovian system. Then, (45) represents a genuine 
NESS. 

Let us assume that the system is initially prepared 
in the steady state associated to the force fo and that 
f(t) = fo + 5f(t). In this case we identify the observable 
b(t) as 



b(t) 



fa - kx(t) 
kT eti 



(46) 



Note now that we can rewrite (44) as follows 

x(t) = G 1 (t)x +^(1-G 1 (t))+ J dTG 2 (t-r)Sf{r)+ri(t), 

(47) 

where we have made use of (32). From (45) we see that 
(xq) — fo/k, which implies 



<&(*)> = -(T*ff) / drG 2 (t - T)Sf(r). (48) 
Jo 



Now, for the unperturbed system we can write 



b(t) = -(Teff)- 1 



from where it follows recalling (31) 

(b(t)b(t')) ss = (kT eM )- 1 G 1 (t - t'); t > t>. 
Now, using (32), we can write 
d 



dt 



(b(t)b(t / )) ss ^~(T eii )- 1 G 2 (t-t / ). 



(49) 



(50) 



(51) 



Then, comparing (51) with (48), we conclude that 



(&(*)> = J*dt'~{b{t)b{t')) ss 8f{t'), (52i 



which completes the proof. Then, we have checked the 
general result (25) for a genuine non-Markovian system 
with NESS. 



VII. CONCLUDING REMARKS AND 
PERSPECTIVES 

We have shown that, in strong contrast with Marko- 
vian systems, non-Markov dynamics may be unstable, in 
the sense that a system prepared in such a way that the 
initial positions are sampled from the steady-state PDF, 
may depart from this state at finite times even if the 
external protocols are kept constant. 

For stable systems the non-adiabatic entropy produc- 
tion satisfies an integral fluctuation theorem and the 
second law of thermodynamics for transitions between 
NESS holds, exactly as for Markov dynamics. On the 
other hand, the generalized FDR is also verified, clarify- 
ing that, contrary to what is often asserted that this re- 
lation only holds for Markovian systems, the conditions 
which need to be fulfilled are ergodicity and stability. 
However, if the stability condition fails, it turns out that 
the generalized FDR does not hold anymore. We believe 
that this is the reason why the generalized FDR has re- 
mained elusive up to now for non-Markov dynamics. It 
is common to see this issue discussed in the literature 
by the study of models violating the stability condition 
(see for example the model discussed in Rcf. [18] related 
to a molecular motor with an internal relaxation time, 



which is a reliable model for the experimental situation 
presented in Ref. [45]). 

The time derivative of the average non-adiabatic en- 
tropy production can be written as a sum of products of 
generalized fluxes and forces, even without stability. This 
could be relevant for the experimental determination of 
this quantity if one is able to determine the steady-state 
distribution of the system, since the particle current can 
also be determined in the experiment. On the other hand, 
the determination of the currents may give direct infor- 
mation about the properties of the evolution operator. 

Some interesting open questions remain to be an- 
swered. First, the integral fluctuation theorem (15) sug- 
gests that a detailed fluctuation theorem may also hold 
if one introduces a dual system so that the non-adiabatic 
entropy production can be expressed as the logratio of 
the forward path probability of the original system and 
the time-reversed path probability of the dual system. 
This also could make easy to identify an adiabatic en- 
tropy production, such that the total entropy production 
can be split as in [32]. Second, it would be interesting to 
generalize the FDR to the case when the system is unsta- 
ble. In this case, we speculate that some 'violation' terms 
should appear and it would be interesting to investigate 
their precise form and physical meaning. It would be also 
interesting to relate that case to the recent results pre- 
sented in [44]. Third, some immediate improvements of 
the present theory can be developed in order to describe 
a wider variety of systems. For example, an extension 
of this theory to describe also non-ergodic systems, can 
be attempted in the spirit of Refs. [41, 42]. In those 
references, generalized Hatano-Sasa identities have been 
obtained in terms of functions which are not related to 
the steady-state PDF. This may be relevant if the steady 
state is not univocally determined, as it is the case for 
non-ergodic systems. With this improvement, the same 
formalism could be used in order to describe such com- 
plex systems as glasses far from asymptotic states. 
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